Comparative Study Load Balance Algorithms for Map Reduce environment
نویسندگان
چکیده
MapReduce is a famous model for data-intensive parallel computing in shared-nothing clusters. One of the main issues in MapReduce is the fact of depending its performance mainly on data distribution. MapReduce contains simple load balance technique based on FIFO job scheduler that serves the jobs in their submission order but unfortunately it is insufficient in real world cases as it missed many factors that impact the performance such as heterogeneity factor and data skewness, so Load balancing is important to make all resources utilized evenly and more efficiently. There are two main schemes in load balancing aStatic Load Balancing Schemes bDynamic load balancing. The main aim of this work is to study and compare existing Load Balance algorithms also to illustrate the features of Load Balance algorithms Keyword Static Load Balance, Map reduce,Dynamic Load Balance,static load balance,comparative study
منابع مشابه
OS4M: Achieving Global Load Balance of MapReduce Workload by Scheduling at the Operation Level
The efficiency of MapReduce is closely related to its load balance. Existing works on MapReduce load balance focus on coarse-grained scheduling. This study concerns finegrained scheduling on MapReduce operations, with each operation representing one invocation of the Map or Reduce function. By default, MapReduce adopts the hash-based method to schedule Reduce operations, which often leads to po...
متن کاملImproving the Load Balance of MapReduce Operations based on the Key Distribution of Pairs
Load balance is important for MapReduce to reduce job duration, increase parallel efficiency, etc. Previous work focuses on coarse-grained scheduling. This study concerns finegrained scheduling on MapReduce operations. Each operation represents one invocation of the Map or Reduce function. Scheduling MapReduce operations is difficult due to highly skewed operation loads, no support to collect w...
متن کاملComparative Study of Job Migration Algorithms for Autonomic Grid Management
Resources form the basis of a Grid. Resource management and load balancing are the main areas of concern in a distributed, heterogeneous and dynamic environment like Grid. Load balancing may further cause Job migration or in some cases re-submission of Job. In this paper a number of job migration algorithms have been surveyed and studied which have resulted because of the Load balancing problem...
متن کاملA COMPARATIVE STUDY FOR THE OPTIMAL DESIGN OF STEEL STRUCTURES USING CSS AND ACSS ALGORITHMS
In this article, an Advanced Charged System Search (ACSS) algorithm is applied for the optimum design of steel structures. ACSS uses the idea of Opposition-based Learning and Levy flight to enhance the optimization abilities of the standard CSS. It also utilizes the information of the position of each charged particle in the subsequent search process to increase the convergence speed. The objec...
متن کاملOptimization of sediment rating curve coefficients using evolutionary algorithms and unsupervised artificial neural network
Sediment rating curve (SRC) is a conventional and a common regression model in estimating suspended sediment load (SSL) of flow discharge. However, in most cases the data log-transformation in SRC models causing a bias which underestimates SSL prediction. In this study, using the daily stream flow and suspended sediment load data from Shalman hydrometric station on Shalmanroud River, Guilan Pro...
متن کامل